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ABSTRACT 



The Comprehensive School Mathematics Program (CSMP) 
is a program of CEMREL, Inc., one of the national' educational 
laboratories, and was funded by the National Institute of Education 
(NIE). Its primary purpose is the development of curriculum materials- 
for kindergarten through grade 6. This study compared CSMP' and 
non-CSMP second-grade students' performance at two sites using a 
streamlined revision of the Mathematics Applied to Novel -Situations 
(MANS) test. .Twelve CSMP and nine non-CSMP classes were - tested. 
Results showed that CSMP classes scored significantly, higher at the 
.09 level on 7 of t 13 scales. The Jbest performances by program pupils 
was on measurements dealing with number relationships, mental 
arithmetic, and number fluency. Thefe was no difference between CSMP 
and non-CSMP groups in computation scores. The findings are seen as 
corroborating more extensive prior testing results, except that two 
scales showed larger CSMP advantages. It is felt the results are also 
noteworthy because the simplification of the testing procedures v 
should make them easier for districts to use. (MP) 
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Description of Evaluation Report Series 

to use. ttem in first and second grades respectively in 1S7&S tl iSV*.^ 
subsequent years. Hence the adjective "extended". 197 *- 75 ' » nd *> on in 

The evaluation of the program in this extended pilot trial is intPrvW tn k 0 
ISSSl y - C ? mpr f e |; e ; sive and t0 s "PPly information desired' £ < w de JSl&V 

1 c : J or -reason the reports in this" series' are reasonably non-technical * 
?Sl nh n0t 3tt - mp • ?° widely-explore some of the related issues. The list of reports 
through year six is given on the next page. The following reports are planned 



year 7: 



7-B-l 
7-B-2 
7-B-3 



Fifth Grade ^valuation: Volume I, -Summary 
Fifth Grade Evaluation: Volume II, Test Data 
7 d 1 o 5 ? rad ? Evaluati °n : Volume III, Non-Test Data 
7 "Si ' 5 e :^ aluat l°n of Second Grade,' Revised MANS Test's 
7 S~f " A ^ n l evement of ^rmer CSMP Students at Fourth Grade 
/-B-6 - Student Achievement, Rapid Implementation Model " 
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Summary 

This study compared CSMP and non-CSMP students' performance at two sites 
using a streamlined revision of the MANS Tests (Mathematics Applied to Novel. 
Situations, intended to assess some of the underlying thinking skills of -the 
■ CSMP curriculum without using any of its special vocabulary). A total of 21 
classes* were tested, 12 CSMP -and* 9 non-CSMP. The CSMP classes had studied- 
the revised version of the CSMP curriculum. 

On the total of the MANS Scales, CSMP classes averaged about 15% higher ■ 
scores than non-CSMP, a difference which was significant at the .01 level. 

On seven of the 13 individual, scales, CSMP classes scored significantly 
higher at the .05 level. Their best performance was in- scales dealing with 
number relationships, mental arithmetic and numbey fluency. They did slightly* 
better in estimation and word problems. There was no difference in, computation 
scores. • . 

3* 

These findings corroborate the findings from the more extensive Extended, . 
Pilot Test, conducted prior to revisions, except that there were larger CSMP 
advantages in two of the individual scales. The findings are al so? noteworthy . 
because the simplification of the testing procedures should make it easier 
for other districts to use these tests which remain, nevertheless, powerful 
■enough to short various cognitive effects of the CSMP curriculum. <■ 
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' ■ * Introduction 

* » 

t r 

V 

The, Comprehensive Schpol Mathematics Program (CSMP) is a K-6 mathematics 
curriculum being developed and |ieid tested by .CEMREL, Inc. During the pas* 
few years, a special series of tests, the MANS Tests (Mathematics Applied to 
Novel Situations) has been developed for use in the evaluation of CSMP..<jhis 
report presents, two -kinds of data. ' . 

a) Statistical data bn a revised set of MANS scales. 

A serves of 10 MANS scales was original.ly developed in 1976' for .use in 
second grade in the CSMP Extended Pilot Test. Like all MANS scales they were 
intended to assess 'important mathematical thinking skills thought to underlie 
the CSMP curriculum, but in a novel context where possible and without using 
any of the special terminology and techniques of the CSMP curriculum. They 
required extensive dfrections* and explanations,, given in a standardized manner 
by specially trained testers. They were administered. to 70 second grade 
classes, some CSMP and some • n on -CSMP classes, and the. results of this 
experimental comparison are. given in Evaluation Report 3-B-l. 

Because of the expense and effort required to train testers, these scales 
have had. .limited utility outside the'realm of CSMP Evaluation activities. In 
order to make them more widely available, these scales were revised in 
1979-80. The primary objective was to simplify the directions enough that 
a local .coordinator could fairly easily train a tester to carry out the testing. 
(Other revisions were also made based fin statistical 'data from the original 
study and on new scales developed 'later in higher grades, but appropriate in 
concept for use with- second graders.) Jhese revised scales were deno'ted as 
the "Blue" Level, intended for second graders, but appropriate for certain 
first and third grade classes as- well.' + 

b) Evaluation data for CSMP second' grader.s (used revised curriculum) 

^ After the completion of the Extended Pilot Test for the second grade 
curriculum, final" revisions were made in the curriculum, as in the case 
with other g v rade' levels. -Thus it is possible-to compare the results of 
this study with those from the original Extended Pilot Test in order to 
determine whether the relative 'achievement of'cSMP students has changed ' 
with the revised curri'culum. 



Setting 

V 

In May 1980,, these scales were^administered in three school districts. 
Two of the districts, District 1 and District 2, .were small-city school 
districts, which had recently .begun using CSMP in some of their schools. 1 
In addition, to the MANS data, the two districts provided reading scores, 
from district-administered. tests as shown in Table 1. The third district, 
District 3, was a medium sized city in which only 3 classes participated and 
no reading scores were available'.-" 

» 

Table 1 



' • Participating Classes' 



District 


Number of Classes 


Average number of 


Mean Reading Score^ 


students 


per class 


tSMP 


non-CSMP 

r 


CSMP 


non-CSMP 


. CSMP 


non-CSMP 


* 1 
2 
3 


5 
7 
2 


5 
1 


19 
23 
17 


. 18 
21 
22 


22.7. 
392'" 
NA 


24.8 
371 
' NA 



'. For District 1: Raw Score, Vocabulary Test, Iowa Test of Basic Skills, 
Level 8, Form 7 ' 
For District 2: Standard Score, Total Reading, Comprehensive Test of Basic 
Skills, Levpl C, Form S 
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The MANS Scales and Summary Statistics Across Students 
» •* 

For each scale, brief directions and a sample item are,g'iv'en on the next 
Also. given are the number of items per form and some of the time limits 
a few scales, all students took the same form*. But for -most scales (those 
indicated by "x items, two forms"), each student took SMSl of the two forms. 
For most scales, a flexible 'and sufficient amount of time was allowed. For 
a' few scales, dealing with problems meant to be done without exact calculation, 
strict time limits were adhered to; for these particular scales, the avowed 
time has been shown. ^* 

The statistics given are the means across all CSMP students and* across 
all non-CSMP students, and the pooled standard deviation. Where there were 
two forms, there will be two rows of data, one for each form. There were 
about 290 CSMP students and 190_non-CSMP students, although where there were 
two forms only about half these numbers "would have taken each form. An 
asterisk has been placed beside the means where the difference in mean scores- _ 
is^significant at the .05 level (using a simple t-test). 

Appendix A gives -the actual t4st items together with various item 
Statistics. These also are based on students from all 25 classes, In the, 
next section, an analysis of class means will be presented for those 21 classes 
on which a reading score was also available. This, allowed the use of Analysis 
of Covariance procedures on the class means, "a more appropriate (and s 
conservative) method of analysis. Data from both methods are presented in 
this report (this section and next.) and_. it is- the case that they yielded 
virtually identical re'sults as far as statistical significance is, concerned. 
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Which is Larger? * 

Given two similar computation problems choose the one 
which gives the larger answer. Sufficient time to work 
out exact answers was not given; the larger answer could 
always be determined by 'inspecting the two problems. 



DSMP Inon-CSMP 



e.g. 



585+250 Q 

580 + 290 [~] ^ Ch6Ck the larger 0ne * 
(9 items, two foijms, time allowed = 3 minuses) 



Above or "Below Zero 

Given the starting score (which could be above or below 
zero), and how much the score went up or down, determine 
the final score. * 



e.g. 



Score at the start: 


7 below zero 






Then: 


Won 3 






Score it the end,? 










10 below 4 below 


4 above 


10 above 



(4 items, two forms) 



Mean Correct' 



5.3 
3.6 



1.8 
2.3 



5.0 
3.3 



1.5* 
2.1 



Standard 
Deviation 



2.0 
1.8 



1.1 
1.1 



3. 



e.g 



Labelling Number Lines 

Given a number line with some of the marks labelled, 
label the indicated mark^.('the intervals between 
marks varied from item to item and was never "1". 



2.4 
2.7 



1.5 * 
1.9 * 




(5 items , two forms) 



1\3 
1.5 



4, Place Value ; 

a) Write -a. number that is read -aloud • 

b) Given a number, determine what number is 1, 10 or 100 

larger or smaller than the number-. /' 
e.g. I .J^ 



What number is 10 more than 402?, 



7.8 
7.6 



5.7 * 

6.9. 



(1JL items, two forms, but 5 items of type a) in common) 



4.1 
3.0 



1 



**- -*= difference in mean scores significant at the .05 level. 
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S. Computation 



"and s 



:SMP non-CSMP 



, Addition and subtraction - up %o two digits 
Multiplication..- basic facts 

(9 items, two forms) 



.Mean Correct 



6.7 
6.7 



6.8 
6.7 



Standard 



Deviation 



2.0 

2.0' 



6. Number Fluency . 

Given sample number sentences about 9 (9 ='10 - 1, 
9 = 1 + 5 + 3, 9 3 x 3, 9 = 18 * 2) maj<e up as 
many number sentences as you can about 8. 

, f " ' 

(open ended, but a maximum of 16 were counted, 

. common to both-forms, tfme allowed = 4 minutes) 



7i4 * 



5.5 



7. 



e.g. 



Sequences ' ■ 

Determine the missing number in a given sequence of number 



4.1 
3.5 



3.7 * 
2.9 * 



28, 25, 



19, 



16, J3 



(5 items, two form's) 



1.6 
1.7 



8. .Number Relations » ', 

Given some pairs of numbers, determine the common 
relationship between the first ^nd second number. 



•9- 


David's Game 
















■ Class 


David's 




said: 


answer; 


• * 


F1r*t clue:. 5 


10 






Stcond clue 1 


2 






Third clue: 3 


6 






Question: 4 







*(4 items, two forms) 

5 



*9. Large Number Computation v 

Put the number in the box' which makes the number 
sentences true, where the box may be In any of the 
"3 positions" , and where the numbers are large and 
easy-to-work with. ' 



e.g 




(12 items, two forms) 



1.8 
1.8 



VI. 4 * 
1.4 * 



6.7 
6.7 



'ERJC 



5.9 
5.6 * 



1.2 
1.4 



3.1 
3.3 



v 10. Word Problems 



e.g, 



Each problem* has a series of cartoons illustrating the 
story, with a sentence below each cartoon, which 



sentence is also read to the students. 



How many bananas did 

ht buy? 




BiH spent St to Bananas cost 2t each, 

buy son* bininis. * 

'(8 items, common to both forms) 



■Mean Correct 



CSMP non-CSMP 



5.4 



5.1 



Standard 



Deviation 



2,2 



11-13. 'Estimating intervals 

Given a computation problem, and 5 fixed intervals 
• (0-10, 10--507 50-100, 100-500, 500-1,000), 
determine which interval contains the answer to 
the problem, by putting- an x in the interval. 
Students did not have time to compute exact answers. 

11. Addition 



3.8 



e.g. 



51*53 



10 



50 



100 



SCO 



IQOOj 



v ° (8 items, common to both forms, time allowed = lh minutes) 



12. Subtraction- 



2.6 



e -g- [900 - '601 ~o~ 



10 



so 



100 



soo 



looq 



' (6 items, common to both forms, time allowed = lh minutes) 

• « 
13. Multiplication ' 



3.5 



2.0 



2.3 



1.4 



2.2 



1.8 * 



1.2 



e.g. 



5x11 o 



10 



so 



100 



soo 



1000 



(5" .item's, common to both forms, tinje allowed s lh minutes') 
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v i Analysis' of Class Means 

^ .The following procedure was ajdopted for each MANS scale: 

1 

a) Only classes for which reading scores were available were used, 
i.e. the 21 classes jn Districts 1 and 2. Individual students in these' ' 
classes who did not have a reading score wer^e eliminated from the study 

•^4|. u |UyJe : ss than^o^e per class). i 

I. * * . , 

b) For the remaining, students in each Of the classes,. two' mean scores 
were calculated: the score on the particula'r MANS scale and the- reading score 
for those students on whom that mean was based. (Where a MANS scale had two 
forms, the mean for that test was' the sum of the means of the two forms). 

c) Because different" reading tests were used at each site, a formula 
was used to convert scores from District 1 to be comparable to those from 
District 2. This allowed a pooling of the data from the two sites. 

i r 

d) An analysis of covariance procedure was then used with class aieans as 
the units of analysis and reading as the covariate, thus taking into account 
differences in the general ability level (as measured by reading scores) of 
the classes. 
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Table 2, below, summarizes the^ resulting data: mean*raw scores across 
CSMP and across non-CSMP classes, mean sc6res adjusted for differences in 
reading ability for each of the two groups > and the significance of the 
difference. *he tvio* groups were very similar in fading ability so* that the 
adjusted scores were almost identical to the raw scores. 



Table 2 
Summary of Class Means 





Mean Raw Score 


Mean -Adjusted Scores 






CSMP 








Leyel of 




Non-CSMP 


CSMP 


Non-CSMP 


Significance, 


♦Scale^ 


Classes 


Classes 


Classes" 


Classes 


less than : * 


1. Nnicn is Larger wo) 


9'vl 


> * 
8.2 


9.1 


8.2- 




2. Above or Below Zero (8) 


4.2 


3.6 


4.2 


3.6 


.10 


3. Labelling Number Unes (10) 


. 5.3 


3.5 


5.3 


- 3.5 


.01 


4; Place Value (26) 


15.7 


13.1 ' 


15.6 


13.2 


-.01 


: 5. Cpmputation (18) * 


• 13.6 


13.7 


• 13.5 


, 13.7 




6. Number Fluency (Max = 16) 


10.0 




9.9 ' 


7.. 9 


\ .01 


Reading Score, Tests 1-6 


337 


384 








7. Sequences 4lCf) 


7.8 


6.9 


7.9 


6.9 


.05 


8. Number Relations (7) 


r 3.7 


2.7 


3.7 


2.7 


• .01 


9. Large Number Computation (24) 


13.6 


11.8 


13.6. 


11.8 


.05 


10. Word Problems (8) 


5.5 


5.1 


5.5 


5.1 




11. Estimating Intervals-Add. (8) 


3.8 


3.6 


3.8 


3.6 




12. Estimating Intervals-Sub. (6) 


2.5 


2.3 


2.5 


2.3 


' .10 


13. Estimating Intervals-Mult. (5) 


2.3 


1.8 


2.3 


1.8 


.01 


Reading Score, Tests 7-13 


'386 


387 






• > 


Total 


97'. 1 


84.1 


97.0 


84.3 


.01 


Reading Score, Total MANS 

— r ' 


386 


-386 









The number of f items in each scale is shown in parentheses. Scales 1-6, were 
taken during a single session, and hence all share the same associated reading 
score. Similarly for Scales 7-13. 

2 

Analysis of Covariance, F-Test, with 1 and 18 degrees of freedom. A dash (— ) 
indicates p>.10, where p is the probability of obtaining a difference in 
mean scores this large if the two groups were actually the same from the same 
population.- (i.e. fio "real" differences). * 1 

On eight of the'13 tests, and on total MANS score, CSMP classes had 
significantly higher scores at the .05 level. Three were no significant 
differences in favor of the non-CSMP classes. 

On the next page there is a graph of class means on which, for eacK'classs, 
.total score on the MANS tests is plotted against reading score. , It can be seiffh* 
from the regression line (which is the best overall predictor of MANS score from 
reading score based on all 21 classes) that the CSMP advantage is so olear that 
one hardly needs a test of statistical significance.. , 
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Comparison With* 1 Previous Results 

In order to compare these results based'on the revised curriculum, .with 
those obtained in the Ex/ended Pilot Te*t wityi the original MANS Test, £ 
scale-by-scale comparison of p-values (with the tacit assumption that p<.05. 
is "significant") was majde for scales wh\ch were roughly comparable. These 
similar scales have been grouped together in Table 3, below. One of the 
pres'ent scales and one of the previous scales (quite different, from Qne 
another) are not shown because neither, fits a particular category. * ♦ 



f 



Table 3- 



Comparison of Present r Results With Extended pilot Trial Dat$, 1976 
(Circled .entries favor non-CSMP Classes, otherwise CSMP)" < 



Category 



Present Study 



Scale 



p-value 



•Previous Study 
p-v t alue (Scale Number) 



Number Relations 



7. Sequences " ^ 

8. Number Relations 

3. Labelling Number Lines 

1 . Which i s Larger 



.05 
.01 
.01 
.10 



-> .09 (Al). 
-» .09 (A3) ' 
-> *.88 (Bl) i 
not given 



Fluency 



6. Number Fluency 



.01 
not given 



.19 (B2) - 
-» .43, '(A2) 7 



Estimation 



11. Number Line Estimation - -f- AO 

12. - - ' Al 0 
1'3. ^ - X JOT 



.23 (A4) 



Mental Arithmetic 



9. Large Number Computation .05 
! 4. Place Value * .01 



-> f .01,fA5) 
\. .01 (B5) 



Word Problems 



not given 



10. Word Problems 



.20 



.08 (B3) 



Computation 



5. Computation 



A3 (Local 

(4| standardized 

Jl data) 



i r/ 

These scales and the 'results shown are described in Evaluation Report 3-B-l. 

The present results are very similar to those found previously. , CSMP students 
are much better than non-CSMP students in Number Relations and Mental Arithmetic; • 
somewhat better in Estimation and Word Problems, and no different in Computation. 
The only findings much different from the previous study are the improved 
performance of CSMP students on two scales:" Labelling Number Lines (#3) and 
Number Fluency (#6), findings corroborated at higher grade levels. These 
improvements may very well .be a result of the revision of the second grade 
curriculum. < 

15 
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Appendix A 
'The MANS Scales and Item Statistics 

» 

( ' . • 

On the, pages which follow, the items, for each of the MANS scales are 

given, together wi.th'two statistics. In an .oval beside the" item are given 

'two percentages; the first is the percent of CSM? students getting the 

answer correct and the -second is the percent correct for non-CSMP students, 
e.g. (xx^. 

•* ' ■ < 

Sample items and; tester directions are. not given* but for a. few of the 
scales there are brief, explanations for the reader's benefit. - 

Below is given ttie page number for each scale ,and KR20 'reliability v 
coefficient, which is a measure of homogeneity of the scale (or the degree to 
which the items |re measuring the same thing). In 1 parenthesis' beside each ^ 
coefficient is given the corrected KR20, an estimate of what "the coefficient 
would have been i-f there 'had been 12 items in the scale. Thus, th<f corrected 
relrabi'lities of the Various scales can* be more realistically compared'. 



MANS Scale 



Page 



Number^' 
of Items 



.KR20 Reliability 
Form 1 Form 2 



1.* 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 

11. 

12. 

13, 



Which is Larger 18 

Above and Below Zero 20 

Labelling Number Li ; nes 22, 

Place Value 24 
Computation ' ' ' * 26 

Number Fluency ,, 28 

Sequences 30 

Number Relations • 32 

LArge Number Computation 34 

Word Problems 36 
Estimating Intervals - Add. ' 38 

- Sub. ' 39 

- Mult. 40 



9,9 
4,4 
5,5 ' 
11,11- 
9,9 
16 
5,5 
4,4 
12,12 

8 

8 

6 

5 



.58(.65) 
•50(.75) 
•57(.76) 
.86(.87 
.'71 (.77 



•82(.92) 
.57 (.'80) 
.80(.80) 
.72( 
*65( 
?47( 
.42( 



.49(.56) 
.25(.38) 
.63(.80) 
.84(.85) 
•72(.77). 

« 

.81 (. 91 ) 
.70(.88) 
.85(.85) 
79) 
74) 
64). 
63) 



When two numbers are given, there are two forms of the scale. 



17 



2k) 



Test 1, Which is 'Larger, 

(Check the box for the larger one, or check both boxes if they're equal,) 



Form 1 



I ADDITION 



67+SO []] 
68 + 40, [TJ 



65,63 



6,008 + i 
6,080 + 1 



65,51 



Us ♦ 250 n 
580 + 290 ' pi 



74,73\ 



62 .+ 50 Q 
61+60 [7) 



16,64 



.SUBTRACTION 



5,190 -f □ 



.5,209 - 1 Q 



14 V 75 □ 
149 - 80 QJ 



861 - 570 



□ 



860 - 476 \jQllB 



MULTIPLICATION 

m 



18 



2, 



Test 1, continued 
Form 2 



ADDITION 



230 ♦ 91 □ 

225 ♦ 01 r~n \75*73^ 



91 □ 




173 ♦ 174 Q 
172 ♦ITS- QCS!^/* 



270 ♦ 240 f~j 
'275 ♦ 210 Q 




«78 ♦ 169 LJ — 



SUBTRACTION 



5,187 - i 



5 '(km) ™ ■ ™ P(OT " s - ,! 



"26,20 



MULTIPLICATION 



4 x 101 [] 

3 x 102 r] 




, ZZC 22,-10 



■er|c 



19 



, Test 2, Above and Below Zero. 



Form 3 



V 

A. 



i 



£ . Mar y Score at the start: 6 above zero 



Then: Lost 2 
Score at the end? 



8 above 4 below 4 above 8 above 



Peter 

\ 



Score at the start: 7 below zero 

Then: Won 3 
* Score at the end? 



10 below 4 below 4 above 



10 above 



1 * i 



i 

Ann Sfcort at the start: 3 below zero 
Then: Lost 4 



Store at the end? 



7 below 1 below 1 above 7 above 



42,33 



32,21 



Sam Score at the start: zero 
Then: Won 8 
Score at the end? 



8 below zero Q above , 80 above 




81,75 



Test 2, continued 



Form 2 



John . Scort at the start; .4 below zero 
Then: Won 6 
. Score at the end? 



10 below 2 below . 



Sally Score at the start: 5 above zero 0 
Then: Lost 7 
Score at the end? / 

12 below, ' 2 below 



2 above 10 above 



2 above 12 above 



Hank Scoreat the start: I above 2e ro 
Then: Won S 
Score at the end?, 



6 bklow 4 below 4 above 



6 above 



Hele* Score at the start: zero 
Then; Lost 9 
Score at the end? 

lerb 9 below 



9 above 90 above 



50,44 



'ERIC 
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Test 3, Labelling Number Lines' 



Form 1 



-t— 

17 



19 



— f— 

21 



25 



— f— 

27 



— r- 

29 



-f— 

31 



" i 

116 



— i — 

126 



136 



166 176 



i ■ 
186 



65,46 



H h 



H r 



20 24 28 32 



i r 



36 



— 1 — 





16 



22 




1 * 
I 



H 1— 



H ■ 1- 

t 3* 




9 
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Test 4, Place Value 

(For A to F, students ' had. to write the number which the tester .said aloud; 
these ; are showTflrrparentheses. ) 



a. (491) 



(512) 



c. 



(207) 



p. (820) 



E . (1008). 



f. (7065) ^ 




What number is 10 more 'than 402? 



What number 1s 100 more than 601? 




What number 1s 1 more than 999? 



56,45 



What number 1s 10 more than 495? 



Whit number Is 100 more than 901? 



45,29 



9 

ERIC 



9 ... 
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Test 4, continued 
Form 2 



A. 



0. 



.sill 



c mi 



(820) 



E. (1008) 



(7065) 





51. 33^ 



* Wh*t number 1$ 10 «ore than 247? 



Whit number 1$ 100 wort thin 4B1? 4 _ 



Whit number 1$ 1 sort than 99? 



Whit number 1$ 10 aore thin 900?. 




Whit number 1s 100 nore thin 900? 



50,53 




25 



9 z 



Test 5* Computation 
Form 1 



ADDITION 





4 




6 


7 


62 


±a 


0 


+13 


91,97) 


±5. 


(J3.96J 




(an, as)' 





46 
±£2 



SUBTRACTION. 

' '11 ' 




76 

76,86 



73 
36,44 



MULTIPLICATION • 
1x5= (j^n) 3x4= (70,58 



2j 



26 



Test 5, continued 
Form 2 



ADDITION 



8 



19 
'+.£. 

"82,85 



f s 



5 
43 



124 

■+2QS 

58,89" 



SUBTRACTION 
.14 



. 49 
- 7 




77,69 




679 



70,80 



MULTIPLICATION 



4x2=' 




5x8 = 



9 

■ERIC 
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Test 6, Number Fluency ** 
(Since this was open ended, percentage figures cannot be given.) 

* « 

Number Senten ces 

" 1 — — i 

Mary's number sentences about 9. ' 

• * 

* ' * • ■ • ' . ' • 

9 10 - 1 9=3x3 
9*1+5 + 3- 9 = 18 + 2 



My number sentences about 8 



i 



8 



'8 : 8 

8 ■ 8 

8' , • " 8 -__ 

8 8 

8 -— J 8 - 

8 "-— ■ : 8-_^ 

8 - — Izr: : . s 



3i 

29 



« 



Test 7, Sequences 
Form ] 



12. 11. 10. 8, 



92,86 



5. .7. 11, 13.. 15 




76. '65. 56. 46. 26. .16 



. 26. 25. IS. 16. ' 13 




10, 10*-. 11 03.67 




0 

, ERIC 
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Test 7, continued 
Form 2, 




Test 8, Number Relations 

(Use the three clues to figure out what the student's game 1s, and then 
answer the question.) 

Form 1 



Ann's Game 

, Class 
said: 



Ann's' 
answer: 




lob's Game 



Class 
said: 



First clue: 
Second clue: 
Third clue: 
Question: 



5 
2 
8 
3 



Bob'* 
answer: 

7 
4 

10 



□ 




Cindy's Game 



Class ♦Cindy's 
said: answer: 



First clue: 
Second clue: 
third* clue: 
Question: 



64,57 



10 
7 
6 



□ 




David's Game 



First clue: 
Second clue 
Third clue: 
Question: 



Class 
said: 

5 

1 

3 

4 




33,23 



David's 
answer: 

10 

2 

6 * 



□- 



Note, the first problem, Ann's Game, contained an error. The last line 
should have been 3 Q instead of 1 { j. With the error, the correct answer 
1s negative 2. This scale was not Intended to use negative numbers but 1t 
Inadvertantly happened on this item. 



3^ 

32 ' 



\ 



Test 8,' continued 
Form 2 



Ellen's Gtnt 



CUs 
sti 



First clue: 
Second clue: 
Third clue: , 
Question: 



Ellen's 
tnswer: 

6 

1 

3 



□ 




Fred's feme 



Class Fred's 
s*1d: tnswer: 



fint clue: 
t Second clue: 
Third clue: 
Question: 



4 

i; 

6 

2 



□ 




Greg's Gime 



Cliss 
said: 



First clue: 
Second clue: 

Third clue:^ 

/ 

Question: 



Greg's 
tnswer 

4 

2 
8 




□ 



Helen's Game 



Cless 
seid: 



Helen's 
tnswer: 



First clue: 
Second clue: 
Third clue: 
Question: 



2 1 

a "4 

io 5 

6 




27,15 



□ 




'ERIC 
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Test 9, Large Number, Computation 



Form 1 



20+10 ■ 



96,89 



+ 70 « 90 



□ + 120 -220 



54,47 



* 500 + 500 ■ 




70 -'_40 - [ 



69,77. 

- 200 ■ 100 




423 - 422 

. / 
300- □ 

22, ZT 



□ 



45,40 
■ *»* 

250 



3x20 * [ 



60,46 



x\4 

\ 
\ 



■ 8 



3x □ = 300 



56,37 . 



54,15 



3u 



34 



Test 9, continued 
Form 2 



'40+60 = 1 | 



.79.80. 

50 + □ = 70 



50+150 -rm 

35 + Q .65 • 



600 - 100 



□ 

""IS? 



-49- 0 



90 -O-60 

62, 5jP 

□ - 150 ■ 50 



2 x 400 ■ □ 

10 x □ ,- 90 




Q x 7« W 
i/x □= 100 

25,05 



35 

4* 



3? 



V 



Test 10, Word Problems 



(Tester cead the problems aloud while students read along silently and 
' looked at the pictures.) j 



V 




How many marbles does 
David have now? 




David had 11 marbles 
1n his bag. 



He list 6 marbles. 






Mary's father addtd 3c Then Mary broke her 

tt> her piggy bank. piggy bank and found 7<* 



How much was 1n the 
piggy bank to itart w1tn? 




61,63 



rl 




4 chi idren eameo 
$12 together 



They shared the money 
equally. 



How much did each 
child get? 



4. 




Apples cost 5c eacn and Sally buys 3 apples and 
bananas cost 2c each'. l banana. 



9 

ERIC 
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Test 10, continued 




A fantastic ant 1s After one day the ant 

starting * trip. had <qone 2 miles. 




Mr. Rich lost 100 He still had 200 

dollars. dollars left. 




Bill spent 6c to Bananas cost 2e each, 

buy some bananas. 



8. 




Test 11, Estimating Intervals - Addition 

(To show which two numbers the answer lies between, mark an "x" anywhere 
between those numbers.) 

A DD LT I ON . r 

- ' . - — - 

9*19 .__-o.~~ 10 , so loo.' 5oo 1000 C^LiZi- 



41*41*41 0 10_ 50 100 500' 1000 C?7, 47^ 
23*19 0- 10 50 100 500 10C0 ^51,54^ , 



270*270 o* 10 ^ 50 100 500 1000 C i 5 » 5 0 



51 4 53 ' 0 10 50 100 500 1000 ^47,40 



29*29 0 * 10 50 100 500 1000 vji,44 

I 



189*273 o . 10 so ioo soo " ioco QM1 



e> ^ J_ 0 10 50 100 500 1000 
9 2 



30,23 



38 



Test 12, Estimating Intervals - Subtraction 
(See Test 11) ' 



SUBTRACTION 



90-12 0 10 50 100 500 1000 



105 - 8 0 10 50 100 500 ' 1000 C61.58 



900- 601 0 10 50 100 500 lOOO (46,42 



71- 69 0-10 50 100 500 1000 C 12 ^ 



100- 65 0 % 10 50 100 500 10C0 Q7,24^ > 



990-110 o" io so .100 500 iooo Os.32 



39 



Test 13, Estimating Intervals - Multiplication 

I 



MULTIPLICATION 



3 x 21 o 10 50 100 500 1000 



2 X 209 0 10 50 100 500 1000 



5 X H 0 10 50 . 100 500 1000 ^ 49 ,48^ 



3 X 2II '° 10 50 100 500 1000 V? 6 ' 25 . 



^ X 15 0 10 50 " . 100 500 10C0 



Appendix B 
* Mean Scores by Site 

Table A, next page, shows the mean sqores across CSMP and non-CSMP 
classes in each site for the various MANS scales. Also given are the 
adjusted means for each site but it should be noted that these two studies 
were done independently, using whatever reading score was used in the 
district. Thus adjusted means are adjusted with respect to the other 
cum ' cu1um flroup, but independently of tjje other site. Hence one can 
compare adjusted' means within a site, but not from one site to another. 



43 

41 



0 



TaUle A 
Mean Scores by Site 



s 



r 1 


Dist 


rict 1 


A — — ~ , 

District 2 


Test 


Raw Score Means 

CSMP Non-CSMP 
(n=5) (.n=5) 


Adjusted Means 
CSMP Non-CSMP 


Raw Score Means 

CSMP Non-CSMP 
„ (n=7) (n=4)~ 


Adjusted Means 
CSMP Non-CSMP 


Test 1, Which is Larger 
Test Z, Above and Beiow Zero 
Test 3, Labelling Number Lines 
Test 4, Place Value 
Test 5, Computation 
Test 6, Number Tluency 

Keadi ng 


9.2 8.3 
3.7 3.6 

5.3 3.6 
16.2 14.3 
13.6 15.2 

9.5 8.9 

22.9 24.5 


9.G 7.9 
3.9 3.4 
5.5 3.4 
16.6 13.9 
14.1 14.6 
10.4 7.9 


9.0 8.0 
4.6 3.6 " 
5.3 3.4 
. 15.3 11.7 
1 13.6 11.8 
10.3 6.4 

393 371 


8.8 8-2 
4.4 3.8 
5.1 3.6 
14.8 12.2 
13.3 12.1 
10.1 • 6.6 


Test 7, Sequences 

Test 8, Number Relations * 
, Test 9, Larye Number Computation - 
Test 10, Word Problems 
Test 1 1 r Estimating Intervals-Add!] 
Test 12, Estimating Interval s-SubA 
Test 13, Estimating Interval s-Mult.) 

• 1 

Reading 


7.7 7.4 
• 3.6 3.1 
13.6 13.3 

5.4 5.0 

3.3 3.7 

2.4 2.4 
2.0 1.9 

22.8 ' 24.9 


7.9 7.2 & 
3.6 ' 3.1 
14.6 12.4 
5.6 4.8 
3.6 3.4 
2.5 2.3 
2.1 1.8 


7.9 6.2 
3.8 2.4 
13.6 10.0 
5.6 5.2 
4.2 3.5 
2.6 2.1 
2.4 1.7 • , 

391 372 


7.5 6.6 

3.6 2.6 
12.6 11.0 

5.4 5.5 . 
4.0 3.7 

2.5 2.2 
2.4 1.8 


Total MANS 
Reading^ 


95.5 90.7. 
22.8 24.7 


100.1 86.1 


98.3 75.9 
392 372 


94.3 79.0 



1 



These are the mean reading scores, across classes, based on students present on the day of administration of 
the tests listed immediately above. In District 1, this is the raw score, Vocabulary Test, Iowa Tests \of~* 
Basic Skills, Level 8. In District 2, this is the standard score, Total Reading, Comprehension Test of < 
Basic Skills, Level C. % 



"3- 



9 

ERIC 



•1 



